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Dependence on standardized tests in adult literacy 
programs derives partly from their relative ease of adminstration and 
their appearance of providing valid and reliable quantitative data 
for program evaluation. Few adult educators are satisfied with the 
quality of the information, and most are extremely dissatisfied vith 
the effects of such testing on teaching and learning. Literacy 
practitioners, researchers, and theorists have been working together 
and separately to seek alternatives and reinvent assessment. This 
movement is based on learner-centered or participatory approaches 
that are congruent with recent cross-cultural and ethnographic 
research. To understand and assess the literacy practices of 
different adult .earners, alternative assessment explores the 
particular types of reading and writing that adults themselves see as 
meaningful under different circumstances and that reflect their own 
needs and aspirations. Most important, these new approaches 
communicate respect for adults. Procedures for assessing learner 
progress often include scripted or ethnographic interviews, conducted 
by students with students or by administrators or teachers/tutors 
with students. Some programs use profiles or inventories; others 
integrate assessment with instruction. Support is needed to build 
networks to share questions and findings about alternatives to 
traditional methods of assessment. (YLB) 



ED 300 638 

AUTHOR 
TITLE 
PUB DAIE 
NOTE 

PUB TYPE 
JOURNAL CIT 

EDRS PRICE 
DESCRIPTORS 



ABSTRACT 



****************************************************************** 

* productions supplied by EDRS are the best that can be made * 

* from the original document. * 



ERLC 



)Pocuson • 




World Education » Innovative teacbingpractices fo r adults • Volume 2, Number 1 • Fall 1988 

Inside this Issue 



— 1 



From the Inside Out 

Susan Lytic examines alternatives to tradi- 
tional assessment procedures that build on 
learners' strengths and capture the 
complexities of adult learning. 



5 



Effective Practice 

The Adult Learning Center at Lehman Col- 
lege's Institute for Literacy Studies in New 
York has been reinventing assessment 
through an innovative participatory 
research project. Marcie Wolfe describes 
the process. 



8 



Research Within Reach 

Most of the students at East End Literacy in 

Toronto said they were intimidated by 
tests. With help from the learners and staff, 
Anna Hemmendinger is designing a "Kit*' 
that lets learners evaluate their own 
progress. 



10 



Out the In-Basket 

Learners in a few programs are takmg an 
active role in staff and tutor trammg. Paul 
Jurmo gives examples of successful efforts 
that have involved learners as recruiters 
and trainers of program staff. 



12 



ERIC 



Blackboard 

Information on innovative efforts in alter- 
native assessment. 




U.S. DEPARTMENT OF EDUCATION 
OffiM of Educational Research and Improvement 

EOMCATIONAL RESOURCES INFORMATION 
CEHTER (ERIC) 

This document has been reproduced as 
received from the person or oroanizatton 
onginating it 
O Minor changes have been made to improve 
reproduction quality. 

• Pointsof view or opinions stated in this docu* 
ment do not r>ecessan(y reprasent offtctal 
OERI position or policy. 



'PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 




TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC)." 



From The Inside Out: 

Reinventing Assessment 

Participants in the growing national dialogue about assessing learner 
progress enter the conversation from a variety of perspectives. Most 
agree that decisions about the nature and purpose of assessment have 
become critically important to literac> policy and practice at all levels of the 
system. Adult learners, teachers and tutors, program administrators, and 
funders all concur that what programs choose to assess and their methods 
for doing so dramatically affect the quality and outcomes of teaching and 
learning. 

There is considerably less agreement about the efficacy of different 
approaches to assessment and the interests which they serve. Many, if not 
most, literacy programs assess individual learners wilh commerciallv avail- 
able standardized t sis of reading achievement. Although heavily criticized 
by university and program-based researchers and practitioners, the tests are 
still widely used. In a recent symposium in Washington, D.C., designed to 
explore new approacnes to adult literacy assessment, for example, seven of 
the ten invited presenters reported use of standardized tests (e.g. the TABE 
or ABLE) as their primary mode of assessment. 

continued on page 2 
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From The Inside Out: 

Reinventing Assessment 



continued from page 1 

Dependence on standardized 
tests in adult literacy programs 
undoubtedly derives in part from 
their relative ease of administration 
and their appearance of providing 
valid and reliable quantitative data 
for program evaluation. The equa- 
tion of learner progress assessment 
(defined as increasing reading levels) 
with program evaluation is prob- 
lematic in two ways: (1) it ignores 
other legitimate criteria for evaluat- 
ing a literacy program (e.g. quality 
of curriculum and teaching, connec- 
tion to significant community 
issues), and (2) it fails to recognize 
that increases in reading levels have 
little to do with the way adults live 
in the world. Once again, as Carman 
St. John Hunter pointed out in a 
recent issue of World Education's 
REPORTS Magazine, the failure to 
change is attributed to qn individual's 
illiteracy, while literacy itself is 
seen as the remedy, and literacy 
instruction, a remedial program. 

Despite the convenience of 
standardized tests and the numbers 
they provide, few adult educators 
are satisfied with the quality of the 
information and most are extremely 
dissatisfied with the effects of such 
testing on teaching and learning. 
Standardized tests reflect assump- 
tions about reading and notions of 
progress — i.e. reliance on grade 
level equivalencies — which many 
argue are inappropriate and mislead- 
ing for use with adults. Assessing 
decontextualized skills of word rec- 
ognition and paragraph comprehen- 
sion seems incongruent with the 
diversity of literacy practices in 
everyday life and the range of pur- 
poses for which adults seek instruc- 
tion. When literacy is defined as a 
set of neutral and technical skills, 
and adults are informed that their 
reading performance is comparable 
to second or third graders, much 
more is being communicated than 



an objective description of ability 
(see Michael Holzman, "Evaluation 
in Adult Literacy Programs," in 
Writing as Social Action. Ports- 
mouth, N.H.: Heinemann, forth- 
coming Spring 1989). As John 
Gordon, ? ^eacher and program 
director in New York, puts it, "The 
emotional power of the standard- 
ized test is hard to counteract, 
among both teachers and students. 
Confusion and ambivalence about 
goals and philosophy often result." 



Seeking 
Alternatives 

The call for alternatives to tradi- 
tional procedures is coming from 
many participants in literacy educa- 
tion. Teachers and tutors in different 
types of programs recognize that 
learners bring their own intentions 
or purposes, considerable prior 
knowledge of language, and diverse 
strategies for organizing and using 
what they know. Drawing on cur- 
rent theory and classroom research 
in language and learning as well as 
their own exp-^rience, many teach- 
ers also understand that reading and 
writin ,are social and meaning- 
making processes. They are best 
learned — and assessed — together 
and in relation to the particular 
goals and interests of groups and 
individuals. 

Assessment that serves the edu- 
cational needs of adults must be an 
informing process in the positive 
sense. To build on learners' strengths 
and capture more of the richness 
and complexity of adult learning 
seem important goals for alternative 
forms of assessment. 

In theory, assessment can be 
designed to-serve a variety of pur- 
poses and constituencies, but if it 
fails to serve learning, its other attri- 
butes are of little consequence. 
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Reinventing Assessment 



In the last several years, literacy 
practitioners, researchers and theor- 
ists have been moving together and 
separately to reinvent assessment. 
This movement is based on 
learner-centered or participatory 
approaches that are congruent with 
recent cross-cultural and ethno- 
graphic research. The research 
offers a compelling picture of 
multiple literacies — diverse literacy 
practices within and across con- 
texts. Focusing on the social, politi- 
c?l and economic nature of these 
practices, studies such as those of 
Brian Street, Shirley Brice Heath or 
Scribner and Cole reinforce the 



notion that standardized measures 
reflect not a universal literacy but 
attribute value to particular literacy 
conventions. 

The search for alternatives to 
traditional assessments also derives 
strength from more than a decade of 
significant research on the intellec- 
tual and social processes of reading 
and writing. We have information, 
for example, about the part **meta- 
cognition" or knowledge of one's 
own thinking plays in the strategic 
control of language processes. We 
no /7 understand more about the sig- 
nificant role of a reader's or writer's 
prior knowledge in acquiring and 
developing literacy, anc ve recog- 
nize that since meaninj;' are made in 
the context of prior meanings. 



people can be expected to differ sty- 
listically in the ways they read and 
write. 

To understand and assess the 
literacy practices of different adult 
learners, alternntive assessment 
explores the particular types of 
reading and writing which adults 
themselves see as meaningful under 
different circumstances and which 
reflect their own needs and aspira- 
tions. If literacy is culturally learned 
and practiced, what is important is 
what counts as literacy to different 
groups and individuals within the 
society. From this perspective, both 
teachers and students have the 
potential to learn more about what 
constitutes growth or change in 
learners* intentions, in their knowl- 
edge of specific uses and functions 
of literacy, and in the varied literacy 
events or activities in which they 
participate. 



Learner-Centered 
Assessment 

By definition, learner-centered 
or participatory assessment differs 
considerably from program to pro- 
gram, teacher to teacher, and learner 
to learner. However, in many of the 
grassroots research and staff devel- 
opment projects currently under- 
way several general features are 
emerging: 

• Adults are active participants, 
co-investigators in determining 
and describing their own literacy 
practices, strengths and strategies. 
Whether initiated by an adminis- 
trator, teacher/tutor, or by adults 
themselves, the design and imple- 
mentation of the procedures con- 
stitute a dialogue or collaboration. 

• Rather than adhering strictly to a 
pre-determined script, learner- 
centered assessment involves 
dynamic exchanges among learners, 
texts and teachers/tutors. When 
difficulties are encountered, assis- 
tance is given rather than with- 
held; the social situation provides 
a supportive context for experi- 
mentation and risk-taking. 

• Current students may play a role 
in designing and assisting with the 
assessment of incoming students. 

• Assessment occurs initiallv and 
throughout the literacy program, 
not just to establish "entrance" 
and "exit" criteria, but to serve a 
variety of purposes including self- 
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assessment, placement, program 
monitoring, materials selection, 
curriculum design, teaching, etc. 

• Assessment is eclectic, involving 
the use of a variety of procedures 
rather than depending on a single 
process. 

• Assessment is assumed to be a 
learning experience (i.e. not 
bracketed and separated in time 
and place) and thus is increasingly 
enacted in classroom settings and 
integrated with the curriculum. 

« Assessment is increasingly inter- 
related with other facets of the 
program — e.g. staff develop- 
ment, referral, and placement. 

• What's assessed reflects the par- 
ticular goals of the learners and 
often includes (a) literacy prac- 
tices in everday life (how adults 
are using what they've learned 
and what significance these things 
have in their lives), (b) varieties of 
tasks and strategies for reading 
and writing particular texts in spe- 
cific contexts, as well as (c) learn- 
ers' perceptions or theories of 
reading and writing. 

® Practitioner research in alternative 
modes of assessment contributes 
to inter-program communication 
and helps to build communities of 
adult educators. 

Probably most important, these 
new approaches to assessment 
communicate respect for adults 
—for what they bring to learning 
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and for what they come to learn. 
Alternative approaches to assess- 
ment assume that adults make deci- 
sions about literacy within the 
contexts of their own lives. 



Assessment Strategies 

Procedures for assessing learner 
progress often include interviews, 
scripted or ethnographic, con- 
ducted by students with students 
(see "Efrective Practice" this issue) 
or by administrators or teachers/ 
tutors with students (see the Adult 
Literacy Evaluation Project, "Black- 
board" this issue). Some programs 
use various inventories or profiles, 
often based on data collected over 
time from participants in a particular 
program. To explore the role of 
literacy in everyday life, learners 
describe the variety of contexts in 
which they engage in literacy prac- 
tices including what, where, when 
and with whom they read and write 
as well as how they go about it. 
Home, community and work envi- 
ronments contribute to a picture of 
the social networks and contexts in 
which adults currently use or may 
want to use literacy. Successful 
learning and teaching experiences in 
other domains outside of those 
involving literacy may also be dis- 
cussed and their relation to learning 
literacy explored. 



By integrating assessment with 
instruction, classroom discussions 
and projects may also be viewed as 
contexts for assessing progress. As 
learners consider themes and prob- 
lems related to their own lives, for 
example, there is a continuous fund 
of information from which to 
determine strengths, interests and 
future inquiries. 



Directions and Implications 

If accountability to funders and 
legislators remains limited to the 
results of standardized tests, all of 
these promising efforts in the direc- 
tion of learner-centered assessment 
may have little impact beyond indi- 
vidual programs. Lacking good 
information about the qualitative 
effects of programs on learners' 
lives, emphasis nationally will con- 
tinue to be placed on increasing the 
number of adults enrolled in pro- 
grams, and program evaluation will 
continue to be limited to restricted 
measures of learner progress. 

What*s needed in part may be 
wider participation in these conver- 
sations about alternatives. Program- 
based practitioner research conducted 
simultaneously in many sites across 
the country is perhaps the most 
promising route to developing an 
array of workable learner-centered 
alternatives. Mutual efforts to 
rethink assessment have already 
resulted in new linkages among 
programs, universities, centers and 
other organizations which have 
combined their resources to address 
this problem. But more support is 
needed lO build these networks, so 
that we can share questions and 
findings. 

The community of adult educa- 
tors, adult learners, and others 
needs to strengthen these new con- 
ceptual frameworks, to exchange 
and critique innovative practices, 
and to develop strategies for dissem- 
inating this information more 
broadly. Perhaps then we can begin 
a more meaningful dialogue about 
assessment policy at other levels of 
the system. 

Susan £. Lytle 
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